Rate Based ABR Flow Control using Two Timescale SPSA
نویسندگان
چکیده
In this paper, a two timescale simultaneous perturbation stochastic approximation (SPSA) algorithm is developed and applied to closed loop rate based available bit rate (ABR) ow control. The relevant convergence results are stated and explained. Numerical experiments demonstrate fast convergence even in the presence of signiicant delays and a large number of parameterized policy levels.
منابع مشابه
Optimal Multilevel Feedback Policies for ABR Flow Control using Two Timescale SPSA
Optimal multilevel feedback control policies for rate based flow control in available bit rate (ABR) service in asynchronous transfer mode (ATM) networks are obtained in the presence of information and propagation delays, using a numerically efficient two timescale simultaneous perturbation stochastic approximation (SPSA) algorithm. Convergence analysis of the algorithm is presented. Numerical ...
متن کاملReinforcement Learning Based Algorithms for Average Cost Markov Decision Processes
This article proposes several two-timescale simulation-based actor-critic algorithms for solution of infinite horizon Markov Decision Processes with finite state-space under the average cost criterion. Two of the algorithms are for the compact (non-discrete) action setting while the rest are for finite-action spaces. On the slower timescale, all the algorithms perform a gradient search over cor...
متن کاملCOST 257 MID-TERM SEMINAR INTERIM REPORT ON AVAILABLE BIT RATE The Available Bit Rate Service Category in ATM Networks
Preface This report gives an overview of results on the Available Bit Rate Service Category (ABR) for ATM networks obtained in the COST 257 action on " Impacts of New Services on the Architecture and Performance of Broadband Networks ". First we give an overview of the ATM Forum specifications of the ABR service category. Examples of ABR switch mechanisms are given, including two new proposals,...
متن کاملMulti-Level Rate-Based Flow Control for ABR Traffic
The rate control mechanism for available-bit-rate (ABR) traffic as defined by the ATM Forum does not distinguish between different types of ABR connections. However, since ABR traffic may result from a heterogeneous set of applications, there is an apparent need for a flow control scheme that can distinguish between and give differential treatment to different classes of ABR connections. In thi...
متن کاملMultiscale Chaotic SPSA and Smoothed Functional Algorithms for Simulation Optimization
The authors propose a two-timescale version of the one-simulation smoothed functional (SF) algorithm with extra averaging. They also propose the use of a chaotic simple deterministic iterative sequence for generating random samples for averaging. This sequence is used for generating the N independent and identically distributed (i.i.d.), Gaussian random variables in the SF algorithm. The conver...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007